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Introduction 



Mathematical instanton bundles on P3 have their analogues in rank-2n in- 
stanton bundles on odd dimensional projective spaces P2 n +i- The families of 
special instanton bundles on these spaces, which generalize the special 'tHooft 
bundles on P 3 , were constructed and described in ||OS|| and [ ST]| . More general 



instanton bundles have recently been constructed in | |AU2[ | . Let MI 2n +i(k) 
denote the moduli space of all instanton bundles on P2 n +i with second Chern 
class C2 = k. In order to obtain a first impression of this space it is impor- 
tant to know its tangent dimension h}End(£) at a stable bundle £ and the 
dimension h 2 End{£) of the space of obstructions to smoothness. 

In this paper we prove that for a special symplectic bundle £ G MI 2n+ i(k) 

h 2 End{£) = (k - 

Such bundles are stable by f A(J 1| | . So for n > 2 the situation is quite different 




to that of P3, where this number becomes zero, which was shown in [|HN 
Since H l End(£) = for i > 3, our result and the Hirzebruch-Riemann-Roch 
formula, see Remark WA 




h l End{£) - h 2 End{£) = -k 2 + k(8n 2 ) + 1 - 4n 



,2 



give 

h l End(£) = A(3n - l)k + (2n - 5)(2n - 1). 

Therefore the dimension of MJ 2n+1 (fc) grows linearly in k, whereas the differ- 
ence h^End^) — h 2 End(£) becomes negative for n > 2 and grows quadrat- 
ically in k. A more important consequence, however, is that in general 
MI 2n+ i(k) cannot be smooth at special symplectic bundles, see section 4 
and |XU2l 



In order to derive our result we fix a 2-dimensional vector space U and 
consider the natural action of SL{2) on P2 n +i = w(U (g> S n U) as in ||ST|1 . 
The special instanton bundles are related to the 5X(2)-homomorphisms (3, 
see [O], and are SX(2)-invariant. We prove that there is an isomorphism of 
SX ( 2 ) -represent at ions 



H 2 (End£) S k - 3 (U) ® S k - 3 (U) ® S 2 (U ® S n - 2 U) 



Acknowledgement This work was supported by the Deutsche 
Forschungs Gemeinschaft. The first author wishes to thank the Fach- 
bereich Mathematik of the University of Kaiserslautern, where this work was 
begun, for its hospitality 
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Notation 



• Throughout the paper K denotes an algebraically closed ground field 
of characteristic 0. 

• U denotes a 2-dimensional if-vector space, S n = S n U its nth symmet- 
ric power and V n = U ® S n . 

• There is the natural exact squence of GL(?7)-equivariant maps for any 
k, n > 1 

-> A 2 U ® ® 5 n _! 4 5 fc ® S n A ,S fc+n -> 

where u is the multiplication map and (3 is defined by (s At) <g> f <g> g >— > 
sf<S>tg — tf<S>sg. This sequence splits and leads to the Clebsch-Gordan 
decomposition of Sk®S n by induction. When we tensorize the sequence 
with [/ we obtain the exact sequence 

— > A 2 £7 ® <g) K-i ^ S fc <E> K A \/ fc+n -> 0. 

• P = P2n+i = PV^ is the projective space of one dimensional subspaces 
ofV n . 

• The terms vector bundle and locally free sheaf are used synonymously. 

• 0(d) denotes the invertible sheaf of degree d on P, Q p the locally free 
sheaf of differential p-forms on P, such that Q p (p) = A P Q V where Q = 
T(— 1) is the canonical quotient bundle on P. 

• We use the abbreviations J-(d) = T ®o 0(d) for any sheaf T of O- 
modules on P, E { T = H\r) = fP(P, J 7 ), tiT = dim WF. If E is a 
finite dimensional if-vector space, E®0 denotes the sheaf of sections 
of the trivial bundle P x E, and E <g> J 7 = (E <g> O) <S>o ? ■ We also write 
mJ 7 = K m <g> J 7 . 

• We use the Euler sequence -> fi^ 1 ) -»■ ^ V ® O -> 0(1) -> and the 
derived sequences in its Koszul complex — > fi p (j») — > A P V V <8> (9 — > 

— *■ without extra mentioning. 

• Ext* (J 7 , Q) = Ext^V, T, Q) for any two 0-modules T and (?. 
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1 Instanton bundles 



1.1 An instanton bundle on P = P2 n +i with instanton number k or a k— 
instanton is an algebraic vector bundle £ on P satisfying: 

(i) £ has rank In and Chern polynomial c(£) = (1 — h 2 )~ k = 1 + kh 2 + . . .. 

(ii) £ has natural cohomology in the range —2n — 1 < d < 0, that is for 
any d in that range h l £(d) ^ for at most one i. 

A A;-instanton bundle £ is called symplectic if there is an isomorphism 
£ — > £ y satisfying (p v = —(p. In this case the spaces A and B below are 
Serre-duals of each other, since H 2n (£(-2n- l)) v = J ff 1 ^ v (-1) £ H 1 £(-l). 

Remark: In the original definition in ||OS|| the additional conditions 



(iii) £ is simple, that is Hom(£,£) = K, 

(iv) the restriction of £ to a general line is trivial 

are imposed. It was shown in |[AQ1|| that (iii) is already a consequence of (i) 



and (ii). Condition (iv) seems to be independent but we do not need it in 
this paper. By ||ST1| special instantons satisfy (iv). 



1.2 Let now A, B, C be vector spaces of dimensions k, k, 2n(k — 1) respec- 
tively. A pair of linear maps 

corresponds to a pair of sheaf homomorphisms 

A®0(-\) ^ B®Q}(1), B®Q}(l)^C®0. 

Here a is the composition of the induced homomorphisms A <g> 0{— 1) — > 
B <g> A 2 V y <S) 0(-l) — ► B ® f2 x (l) and 6 is the composition of the induced 
homomorphismus B <g> ^ 1 (1) — ► B <8> V y ®0 —>■ C ®0. Conversely, a and b 
are determined by a and b respectively as H°(a(l)) and /J°(6 V ) V . Moreover, 
the sequence 

A®0(-l)-*->B®Qi l (l)-£->C®0 (1) 
is a complex if and only if the induced sequence 

a — > b ® a 2 v; v — > c ® v; v 

is a complex. We say that (1) is a monad if it is a complex and if in addition 
a is a subbundle and b is surjective. 
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Proposition 1.3 The cohomology sheaf £ = Kerb/Ima of a monad (1) is 
a k-instanton and conversely any k-instanton is the cohomology of a monad 
(1). Moreover, the spaces A,B,C of such a monad can be identified with 
H 2n £{-2n-l), H l £{-1), H l 8 respectively. 

Sketch of a proof: if a monad (1) is given it is easy to derive the properties 
of the definition. Conversely using Beilinson's spectral sequence, Riemann- 
Roch and in particular (ii), one obtains a monad with the identification of 
the vector spaces as in [ pS|| . The map b is then nothing but the natural map 
1) (g> — > H x £ and the map a is given as the composition of the cup 
product 

H 2n £{-2n -I)® A 2 V n -> H 2n £ ® ^"^(-l) 
and the natural isomorphisms 

H 2n £ ® Q 2n -\-l) = H 2n ~ x £ ® Q 2n ~ 2 {-1) ^ . . . S H x £ (-1) 

arising from the Koszul sequences and condition (ii), see [M in case of P3. 



1.4 Existence and special instanton bundles: Using the special struc- 
ture V n = U ® S^f/ and the Clebsch-Gordan type exact sequence 

_> A 2 E7 ® 5 fc _ 2 ® K-i S-fc-i ® K Vfe+r.+i — > 0, 
see notation, we define the special homomorphism 

®n\i)^ a 2 u v ® 5 fc v _ 2 ® v; v _! ® o 

by 6 = /3 V . We denote K, = Ker (b). It was shown in [ 5T | that b is surjective 
and that 

#°/C(l) C S v k _ 1 ®H°n\2) 
can be identified with a canonical injective GL([/)-homomorphism 

Sl +k -, ® A 2 t/ V A ^ ® A 2 C, 

dual to the map 

® AV„ -> S 2 n+fc-i <8> A 2 U 

which is defined by / ® (s ® #) A (t ® /i) 1— ► (/p/i) ® (sAi). 

In order to construct instanton bundles we have to find /c-dimensional sub- 
spaces 

A C 5 2 v n+fc _ 1 (8 A 2 f/ V C ® A V n v 

such that the induced homomorphism a is a subbundle. By |5TJ, Lemma 
3.7.1, this is the case exactly when PA C P(5'^ n+fc _ 1 ) does not meet the secant 
variety Sec n (C2 n +k-i) of (n — l)-dimensional secant planes of the canonical 
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rational curve Cm+k-\ of PSgn+fc-i, given by u t— > ■u 2n+/c 1 . By dimension 
reasons such subspaces exist, [ |ST|| , 3.7, and hence instanton bundles exist. 

A A;-instanton bundle £ is called special if the map b of its monad is iso- 
morphic to the GL([/)-homomorphism f3 y , that is if there are isomorphisms 
if and ip an d g G GL(V n ) with the commutative diagram 



H l £{-1) 



QV 
D k-1 



V y 

" n 



11 



A 2 U y g> St 



k-2 



n— 1 



Whereas in [|ST|| the family of all special /c-instanton bundles was described, 
examples of different types of general instanton bundles were found in ||AU2 



Remark 1.5 If £ is special and symplectic then, in addition to the special 
GL([/)-homomorphism b = f3 y of its monad, the map a is given by an 

element a G 5 , 2n+2fc-2 as a = K ° ^ where Sfc_i A S^+fc-i is defined by 
«(/)(<?) = «(/<?) and S^-i ^ ^^AVJ is as above, §TJ, 4.3 and 5.8. 
In particular a is a GL([/)-homomorphism, too, and can be represented by 
a persymmetric matrix. 



Remark 1.6 It is shown in [ API ] that special symplectic instanton bundles 
are stable in the sense of Mumford-Takemoto. 
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2 Representing Ext 2 (£, £) 

Proposition 2.1 Let £ be a symplectic k-instanton and let M be the kernel 
of the monad (1). Then Ext 2 (£,£) = H 2 {N®N). 

Proof: The monad (1) gives rise to the exact sequences 

— > N — >B®n\i)-^>c®o — >0 (2) 

and 

— >A®0(-1) — > N — >£ — >0. (3) 
After tensoring we have the exact sequences 

— >A®Af(-l) — > N®Af — >£®M — >0 (4) 

and 

— >A®£(-1) — >M®£ — >£®£ — >0. (5) 

Since £ = £ v we obtain Ext 2 {£,£) H 2 (£ ® £). Sequence (2) implies 
h 2 N{-l) = /iW(-l) = and from this and (3) also h 2 £{-l) = h 3 £(-l) = 
0. Now sequences (4) and (5) yield isomorphisms H 2 (£®£) = H 2 (M®£) = 
H 2 (J\f®J\f). □ 

2.2 In order to represent H 2 (Af®Af) we note that the sequence (2) is part 
of the exact diagram 



1 i 

— ► N — ► B®n\l) C®0 — > 

I I II 

— ► H®0 — > B®V y ®0 C®0 — > ( 6 ) 

i I 
B®0(1) = B®0{1) 

I I 


where H is the kernel of the operator b, which is surjective because b is 
surjective. The left-hand column of (6) gives us after tensoring by 

B<g>H°n 1 (2) H\N® fi^l)) and # 2 (A/" <g> ft^l)) = 0. (7) 

Since b is the Beilinson representation of Af, we have the commutative dia- 
gram 

#W(-1) <g> H°0(1) ^ HW 

\\l \\l (8) 

B®V V ^ C. 
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Moreover, 8 in (7) coincides also with cup: 



B®H°n 1 (2) ^ H\Af (8)^(1)) 

\\i y cup 

ffW(-l)®«(2) 



(9) 



Tensoring the top row of (6) with Af and using (7) we obtain the following 
diagram with exact row: 



C®H\N) — > H 2 (N ®N) 



B®B® A 2 V V 



C®C. 



It follows that 



H 2 (J\f ®N) = Coker{<5>) = Ker($ v ) v . 



(10) 
(11) 



Lemma 2.3 T/ie induced operator $ i/ie composition B <g> S ® A 2 V^ ^? 
-BiSi-B^V^®^ C®C, where a denotes the canonical desymmetrization. 

Proof: The computation of $ is achieved by the diagram 

id B ®B ® o 



B®B® A 2 K V 



I 



id® H°(i(l)) 



B ® ffW(-l)® 5°fi 1 (2) - 

ids ® cup 11 

ide (8 H l (idx (8 t) 



b^h^m^q 1 ^)) 

H l (idx®b) 
C®HW 



C®C 



b (8 irfjfw 
IV 



b®b®v^® 



B ® ffW(-l) <g> C <g> #°£>(1) 

ids(g,yv (8 cwp 



5 <g> v: v ® c 




In this diagram t denotes the canonical inclusion V n v (8 0, and up 

to A 2 V^ iJ°fi 1 (2) and V n v 5°C(1) the map a can be identified with 
if (t(l)). Therefore, the square I is commutative. Square II is a canonically 
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induced diagram of cup-operations and commutative using B = if 1 A/'(— 1). 
The triangle III is induced by the commutative triangle 



and hence commutative, and the commutativity of IV results just from the 
identification H l M = C . Now by definition the composition of the left-hand 
column is $ and the composition of the right-hand column is ids ®idyv <E> b 
since b is defined by (8). 

It follows that $ = (b®id c )°{idB®idvv ®b)o{idB®B®v) = (b®b)o(id®a). 

Remark 2.4 If £ is a /c-instanton bundle it is easily checked that h l £(d) = 
h i 8 y (d) = for i > 2 and d > -1. Using £ v <g> Af again it follows that 



Ext\£,£) = H\£ w ® £) = H\£ y <g> N) = for i > 3. This and the 



Riemann-Roch formula, which can also ad hoc be derived from the monad 
representation, give 



b (g)M (g)n\i) 

[b®id 




h\£ y ®£) -h 2 (£ v ®£) = -k 2 



2n - 1 



+ 8kn 2 - An 2 + I. 



2 
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3 Determination of Ext 2 (£, S) 



We are now able to determine Ext 2 (S, S) as a GL(2)-representation space in 
case of a special instanton bundle. In that case b is the dual of the operator 
(3 : A 2 U g S k ^ 2 <8> Ki-i -> Sfc-i ® K, see notation or O. Then $ v is the 



composition of (3 g (3 and the multiplication map V n ® V n —>■ A 2 V n . In order 
to simplify we choose a fixed basis s,t G U and the isomorphism A 2 [7 = k 
given by s A t. Then 

® S fc _ 2 <g K-i ® K-i ^ 5 fc _i (g 5 fc _i <g A 2 V n 

is explicitly given by 

® v (g <g c/' <g f <g u') = sg ® sg' ® (tv Atv') - sg ®tg' ® (tv Asv') 
- tg ® sg' ® (sv A tv') + tg tg' (g (su A si/) . 



In order to determine the kernel of $ v we consider the GL(U)- 
homomorphism 

Sk-3 <£> g K-2 <g K-2 -> Sft-2 g Sfc-2 ® K-l g K-l 

defined similarly by 

e'(/ g /' g u g u') = sf g s/' g t« g £u' - s/ <g £/' ti/ 
- £/ ® sf ®tu® su' + tf <g £/' g su g si/. 



Up to the order of factors the map e ; is the tensor product (3' g /3' where 
(3' : 5*fe_3 g V n -2 — > St-2 g Ki-i is defined as /5. Hence, e' is injective. Finally, 
we define e as the composition 

S , fc- 3 gS'fc-3gS' 2 V r n -2 ^ 5 , fc _ 3 gS' fc _3gK-2gK-2 Sfc^gSfc^gK-igK-i 
where i is the canonical desymmetrization. Then also e is injective. 



Proposition 3.1 (Sk-3 g Sks g S ,2 \4_ 2 ,e) zs the kernel o/$ v . 



Proof: A straightforward computation shows that Im(e) C Ker(<& v ). In 
order to show equality we reduce A^er($ v ) modulo Im(e) using canonical 
bases of the vector spaces. A more elegant proof using Clebsch-Gordan 
decompositions seems much harder to achieve. Let us denote the bases as 
follows: 
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basis of Sk- 


-3 : 


6 a 


k- 

= s 


-3 a^o 


o < 


a 


< k - 


3 


basis of Sk- 


-2 : 


fa 


= s fe " 


-2— a -^ a 


< 


a 


< k - 


2 


basis of Sk- 


-i : 


9a 


= s fe ~ 


-1—a-j-a 


< 


a 


<k- 


1 


basis of V n . 


-2 : 




= s§ 




< 


fi 


< n — 


2 








= t <2 


) s n - 2 -n» 










basis of V n . 


-l : 


Xjl 


= s§ 




< 


fi 


<n- 


1 






Xfj, 


= t (g 


) s™- 1 -^^ 










basis of V n 






= s £* 


) s n ~^ 


o < 




< n 










= *<g 













For the basis f a ®fp®x IM ®x 1/ , f a ®fp®x IJ ,®x u , f a <g>fp®x lx <g>x l/ ,f a ®fp<g>x IJ ,<g> 
x v we use the index tuplets (a, (3, fi, v), (a, (3, fi, P), (a, (3, p, u), {a,(3,p,V) 
respectively. The set of these indices will be ordered lexicographically 
with the additional assumption that always fi < P. Then, for example, 
(a,(3,fi,P) < (a,(3,\,5). 

Accordingly, the coefficients of an element £ G Sk-2 <S> Sk-2 <S> V n -\ ® Ki-i will 
be denoted by c(a, [3, fi, v), c(a, (3, fi, P), c(a, (3, p, v), c(a, (3,p,v). 

By the formula for $ v we obtain the 

Lemma 3.2 Let £ G S k - 2 ® S k -2 <8> K-i ® K-i- 

(i) The coefficient o/$ v (£) at the basis element g a ® gp^y^ f\y v in Sk-i® 
S k -i ® A 2 V n is 

c(a, (3, fi — 1, v — 1) — c(a, ft, v — 1, fi — 1) 
— c(a, /3 — 1, /i — 1, P) + c(a, /3 — 1, z/ — 1, fi) 
—c(a — 1, /3, fi, v — 1) + c(ct — 1, /3, P, /i) 
+c(a — 1, /3 — 1, //, P) — c(a — 1, (3 — l,v,p). 

Here we agree that each of these coefficients is if one of a, a — 1, (3, (3 — 
1 ^ [0, k — 2] or i/ one o/ — 1, v, v — 1 ^ [0, n — 1] . 

fnj Analogous statements hold for the coefficient o/$ v (£) at g a ®gp®y^/\y v 
for fi <v (without bars) and at g a £g> g@ ® A y v /or fi < u (with two 
bars). 

Lemma 3.3 Let the notation be as above. 7/$ v (£) = then: 

(i) Ifc(a, (3, fi, v) is the first non-zero coefficient o/£ (in the lexicographical 
order), then < fi < v . 

(ii) If c(a, (3, fi, P) is the first non-zero coefficient of ^, then fi ^ 0, v ^ 0. 
fiiij c(a, f3,p,v) is never a first non-zero coefficient o/£. 
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(iv) If c(a, (3, /x, v) is the first non-zero coefficient of then < /x < v. 



Proof: (i) Let c(a, (3, fj,, v) be the first coefficient of £. Then, by Lemma [3]2 
the coefficient of = $ v (£) at g a ® gp® y^+i A y u+ i is 

= c(a, (3, /x, v) — c(a>, (3, u, /x) — c(a, (3 — 1, /x, v + 1) + c(a, /3 — 1, /x + 1) 
— c(a — 1, (3, /x + 1, u) + c(a — 1, /3, v + 1, /x) — . . . 

Since c(a, /3, /x, z/) is the first coefficient, only the first two in this formula 
could be non-zero because the others have smaller index in the lexicograph- 
ical order. Hence 

c(a, (3, /x, v) = c(a, (3, u, /x). 

If /x > z/ then c(a, /3, u, /x) would be earlier and non-zero. Hence, /x < v. 
Assume now that /x = 0. The coefficient of </> v (£) of g a ® gp+i ® ?/o A 2A>+i is 

= c(a, /3 + 1, — 1, v) — c(a, f3 + 1, v, — 1) 
- c(a,(3, -1, v + 1) + c(a,/3, is, 0) =f . . . 

In this sum all but c(a, (3, u, 0) are automatically zero because (a — 1, (3, . . .) < 
(a,/3,0,u) and —1 occurs. Hence, c(a,/3, 0,u) = c(a,/3, u, 0) = 0, contradic- 
tion. 

The statements (ii), (iii), (iv) are proved analogously. □ 



Now we continue the proof of Proposition 3TT . We reduce an element £ G 
Ker($> v ) to Omod Im(e) using Lemma [3] 



a) Assume that the first non-zero coefficient of £ is 

c(a,P,fi,v). 



Then by Lemma 3.3 < /x < za Then the element 



belongs to i^er($ v ). We have 
e(e a ®ep® u^i ■ u u ^) 

= fa® f/3® {Xp ®X U +X U ® Xfj) 

-fa ® //3+1 ® (Xfj,-! ®X U + X v -\ ® X^) 

-fa+1 ® fp® M ® X»-l +X V ® X^i) 

+fa+i ® fp+i ® Ov-i ® aJi/-i + z„_i ® a?A»-i) 

and therefore £' is a sum of monomials of index > (a, /3, /x, v). Hence, we 
can assume that £ mod Im(e) has no coefficient with index (a, [3, /x, z/). 
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b) By Lemma |3.3| we can assume that the first non-zero coefficient of £ has 
index (a, (3,fi, v) or (a, (3, p, v). In the first case we know by Lemma 
[P] that < //, v. When we consider again 

£' = £ - c(a, /3, /i, P)e(e Q <g> <g> • 

we have V (£') = and £' is a sum of monomials of index > (a, (3, //, z/). 
Hence, we may assume that £ mod Im(e) has c(a,f3,p, v) as first non- 
zero coefficient. Again by Lemma EO < //, i/ and 



is a sum of monomials of index > (a, (3, p, v). 
This finally shows that £ = Omodlm(e). 



This completes the proof of Proposition 3.1 
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4 Conclusions 



By Proposition [2.1| , Proposition |3.1] , (11) and Lemma |2l^ we have determined 



the space Ext 2 (£,£). Together with Remark 2A we obtain 



Theorem 4.1 For any special symplectic k-instanton bundle £ on P2 n ,+i 

(1) Ext 2 (£, £) - SU ® SU ® S 2 V^ 2 

(2) dim Ext 2 {£,£) = (k - 2) 2 ( 2n " 1 ) 

(3) dim Ext\£,£) = 4&(3n - 1) + (2n - 5)(2n - 1). 

Let M/2n+i(^) denote the open part of the Maruyama scheme of semi- 
stable coherent sheaves on P2 n +i with Chern polynomial (1 — h 2 )~ k con- 
sisting of instanton bundles. By [[AO 1|] any special symplectic instanton 
bundle £ is stable. Therefore, Ext 1 ^^) can be identified with the tan- 
gent space of MI 2n +i(k) at £. In [|A02|| deformations £' of special sym- 
plectic instanton bundles in MI 2n+ i(k) have been found for n = 2 and 
k = 3,4 which satisfy Ext 2 (£',£') = 0. This shows that in these cases 
there are components MI' 2n+l {k) of MI 2n+ i{k) of the expected dimension 
4(3ri — l)k + (2n — 5)(2n — 1) containing the set of special instanton bundles. 
In particular, see ||A02|| : 

for k = 3, 4 the moduli space MI 5 (k) is singular at least in special symplectic 
bundles. 



However, in case 2n + 1 = 3 we obtain the vanishing result of J 

any special k-instanton bundle £ on P 3 satisfies Ext 2 (£,£) = and is a 
smooth point of MI 3 (k) , 

since any rank-2 instanton bundle is symplectic. 
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